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DESCRIPTION 

SURROUNDINGS EXHIBITING SYSTEM AND SURROUNDINGS 
EXHIBITING METHOD 

TECHNICAL FIELD 
5 The present invention relates to a system which is provided in 

transportation device such as a vehicle, and which shows, to a 
driver, surroundings around the vehicle when starting the 
transporting device that has been in a parked state (stop state). 

10 BACKGROUND ART 

Conventionally, various parking-assisting device for parking a 
vehicle in a desired parking section have been proposed. One 
realized example thereof is a technique for displaying a rear view 
image with respect to the vehicle (i.e. an image of a rear area of the 

15 vehicle) when reversing the vehicle. Further, disclosed by Japanese 
Laid-Open Patent Publication Tokukai 2000-72019 (published on 
March 7, 2000) is a parking assisting device indicating, to a driver, 
a driving operation amount such as a steering angle, for guiding the 
vehicle to the parking section. 

20 However, each conventional technique only provides the 

information for the driver when he/she reverses the vehicle to park. 
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In other words, the conventional technique merely allows a display 
of the rear view image with respect to the vehicle, or allows the 
parking assistance based on the rear view image with respect to 
the vehicle. 

5 Meanwhile, when starting the vehicle in the parked state, 

safety check is necessary in all the directions rather than only in 
the rear direction with respect to the vehicle. However, because the 
conventional technique can merely provide the driver with the rear 
view image with respect to the vehicle, the information that 

10 should be provided for the driver is not always sufficient when 
starting the vehicle. That is, a shape of the vehicle and/or a 
parking location possibly cause a blind spot, and safety in the blind 
spot is hardly checkable for the driver with eyes. 

The present invention is made in light of the problem, and its 

15 object is to provide a system exhibiting a multi-directional image of 
surroundings around transportation device to an operator (e.g. a 
driver, a pilot) thereof when starting the transportation device that 
has been in the parked state (stop state), the transportation device 
requiring manual maneuver. 

20 

DISCLOSURE OF INVENTION 

To solve the problem, a surroundings exhibiting system, of the 
present invention, that is provided in a transportation device 



requiring manual maneuver and that shows, to an operator, 
surroundings of the transportation device in a stop state, the 
surroundings exhibiting system includes: (i) an image capturing 
section for capturing multi-directional image of the surroundings of 
5 the transportation device; and (ii) a display section for displaying at 
least part of the image captured by the image capturing section. 

With the arrangement, the multi-directional image of the 
surroundings of the transportation device is captured and displayed. 
This allows the operator to recognize the surroundings of the 
10 transportation device accurately. Therefore, the operator can 
smoothly and safely start moving the transportation device in the 
stop state. 

Further, the image capturing section may capture an 
omnidirectional image with respect to the transportation device. In 
15 this case, the operator can accurately recognize the surroundings 
around the transportation device. This allows more smooth and 
safer starting operation of the transportation device in the stop 
state. 

Further, in addition to the arrangement, the surroundings 
20 exhibiting system may further include: an ignition instruction 
detection sensor for detecting an operator's ignition instruction to 
the transportation device, the image capture by the image capturing 
section being carried out in synchronization with the ignition 
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instruction. 

In this case, the image capture is carried out in 
synchronization with the operator's ignition instruction. This can 
shorten an operation period of the surrounding exhibition system, 
5 and accordingly can reduce power consumption. Further, the 
operator can recognize the latest situation of the surroundings by 
sequentially displaying, on the display section, the image captured 
in synchronization with the ignition instruction. 

Further, instead of the above arrangement, the surroundings 

10 exhibiting system may further include: a door unlock detection 
sensor for detecting unlocking of a door, the image capture by the 
image capturing section being carried out in synchronization with 
the unlocking of the door. As another arrangement, the 
surroundings exhibiting system may further include: a door 

15 open/close sensor for detecting opening or closing of the door, the 
image capture by the image capturing section being carried out in 
synchronization with the opening or closing of the door. 

With these arrangements, the image capture starts in 
synchronization with the unlocking of the door or the opening and 

20 closing of the door. On this account, the image capture can start 
before the operator takes an operator seat. Therefore, the image 
required for the check on the surroundings can be prepared before 
the operator takes the operator seat and is ready to check the 



surroundings. In other words, the operator can immediately checks 
the surroundings when carrying out the starting operation of the 
transportation device. 

Further, in the arrangement, the surroundings exhibiting 
5 system may further include: (i) a frame memory for storing image 
data of the image captured by the image capturing section; and (ii) 
an ignition instruction detection sensor for detecting an operator's 
instruction to the transportation device, the image data of the 
image captured by the image capturing section being stored in the 
10 frame memory, a most recent image data of the image data stored in 
the frame memory being displayed on the display section upon the 
detection of the ignition instruction. 

In this case, the operator can immediately check the 
surroundings when carrying out the starting operation of the 
15 transportation device. 

To solve the problem, a surroundings exhibiting method, of 
the present invention, for exhibiting surroundings of transportation 
device that requires manual maneuver and that is in a stop state, 
the surroundings exhibiting method include: (i) an image capture 
20 step of capturing a multi-directional image of the surroundings of 
the transportation device; and (ii) a display step of displaying the 
image captured in the image capture step. 

With this arrangement, the multi-directional image of the 



surroundings of the transportation device is captured and displayed. 
This allows the operator to recognize the surroundings of the 
transportation device accurately. Therefore, the operator can 
smoothly and safely start moving the transportation device in the 
5 stop state. 

As described above, the surroundings exhibiting system of the 
present invention includes: (i) the image capturing section for 
capturing multi-directional image of the surroundings of the 
transportation device; and (ii) the display section for displaying at 

10 least part of the image captured by the image capturing section. 

Because the multi-directional image of the surroundings of the 
transportation device is captured and displayed, the operator can 
accurately recognize the surroundings of the transportation device. 
Therefore, the operator can smoothly and safely start moving the 

15 transportation device in the stop state. 

Further, the surroundings exhibiting method includes: (i) an 
image capture step of capturing a multi-directional image of the 
surroundings of the transportation device; and (ii) a display step of 
displaying at least part of the image captured in the image capture 

20 step. 

Because the multi-directional image of the surroundings of the 
transportation device is captured and displayed, the operator can 
accurately recognize the surroundings of the transportation device. 



Therefore, the operator can smoothly and safely start moving the 
transportation device in the stop state. 

For a fuller understanding of the nature and advantages of the 
invention, reference should be made to the ensuing detailed 
5 description captured in conjunction with the accompanying 
drawings. 

BRIEF DESCRIPTION OF DRAWINGS 

Fig. 1 is a block diagram illustrating a structure of a 
10 surroundings exhibiting system according to an embodiment of the 
present invention. 

Fig. 2 is an explanatory diagram illustrating one example of 
images displayed on a liquid crystal panel provided in the 
surroundings exhibiting system according to the embodiment of the 
15 present invention. 

Fig. 3 is a flowchart illustrating one example of processes in 
the surroundings exhibiting system according to the embodiment of 
the present invention. 

Fig. 4 is a flowchart illustrating another example of processes 
20 in the surroundings exhibiting system according to the embodiment 
of the present invention. 

Fig. 5 is a flowchart illustrating still another example of 
processes in the surroundings exhibiting system according to the 



embodiment of the present invention. 

Fig. 6 is a diagram illustrating a structure example of an 
omnidirectional camera provided in the surroundings exhibiting 
system according to the embodiment of the present invention. 
5 Fig. 7(a) is a diagram illustrating one example of portions in 

which the omnidirectional camera is provided, the omnidirectional 
camera being provided in the surroundings exhibiting system 
according to the embodiment of the present invention. 

Fig. 7(b) is a diagram illustrating another example of portions 
10 in which the omnidirectional camera is provided, the 
omnidirectional camera being provided in the surroundings 
exhibiting system according to the embodiment of the present 
invention. 

Fig. 8(a) is a diagram illustrating still another example of 
15 portions in which the omnidirectional camera is provided, the 
omnidirectional camera being provided in the surroundings 
exhibiting system according to the embodiment of the present 
invention. 

Fig. 8(b) is a diagram illustrating yet another example of 
20 portions in which the omnidirectional camera is provided, the 
omnidirectional camera being provided in the surroundings 
exhibiting system according to the embodiment of the present 
invention. 
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BEST MODE FOR CARRYING OUT THE INVENTION 

One embodiment of the present invention will be described 
below. 

5 Fig. 1 is a block diagram schematically illustrating a structure 

of a surroundings exhibiting system (present system) according to 
the present embodiment. The present system is provided in a 
vehicle (transportation device; transportation means) so as to show, 
to the driver, surroundings around the vehicle when starting the 

10 vehicle that has been in the parked state (stop state). With this, the 
present system assists the driver so that he can start the vehicle 
more safely, the vehicle having been in the parked state. 

As shown in Fig. 1, the present system includes an 
omnidirectional camera 1, an ignition instruction detection censor 

15 2, a speed sensor 3, a door open/close sensor 4, a parking brake 
sensor 5, a control section 6, and a liquid crystal panel (display 
device) 7. The control section 6 includes a CPU 10 and a frame 
memory 1 1 . 

The omnidirectional camera 1 captures an omnidirectional 
20 image of the surroundings around the vehicle. The wording 
"omnidirectional" indicates an angle of 360° with respect to a 
direction (axis) substantially perpendicular to earth (ground). As 
the omnidirectional camera 1, the present system adopts an 
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omnidirectional camera that can capture the omnidirectional image 
of the surrounding in an instant. 

The following explains an example of the omnidirectional 
camera 1 with reference to Fig. 6. As shown in Fig. 6, the 
5 omnidirectional camera 1 is provided with a camera 24, a convex 
mirror 23, a casing 21, and a cover member 22 that constitutes a 
part of the casing 21. 

The casing 21 has a substantially cylindrical shape. A sidewall 
of the casing 21 has a transparent region. The transparent region, 

10 which has a predetermined length, is circumferentially constituted 
by the transparent cover member 22. Inside the casing 21, the 
convex mirror 23 serving as a reflector is so located as to 
correspond to a position of the cover member 22 in terms of height. 
A surface of the convex mirror 23 corresponds to a surface of a 

15 convex rotation body obtained by rotating a predetermined convex 
line about a predetermined axis line (vertical axis line of the casing 
21) that will be an optical axis. Examples of the convex line 
include: an arc line, a hyperbola, a parabola, and the like lines. The 
convex mirror 23 is so provided as to protrude in a downward 

20 direction as a whole. Moreover, the convex mirror 23 is provided so 
that it reflects incoming light to in the downward direction, the 
incoming light coming in from outside via the cover member 22. 

Inside the casing 21, the camera 24 is provided below the 



convex mirror 23. The camera 24 serves as an image pickup device, 
such as a CCD (charge-coupled device) or a CMOS (Complementary 
Metal-Oxide Semiconductor) image sensor. The camera 24 receives 
the incoming light that is sent from outside and that is reflected by 
5 the convex mirror 23, and outputs an electric signal that 
corresponds to the light. In the arrangement illustrated in Fig. 6, 
the convex mirror 23 is a reflector having a convex shape (which is 
circumferentially round and protruded in one direction (i.e. 
substantially conical-like shape)), it is possible to capture the 

10 omnidirectional (i.e., 360°) image of the surroundings around the 
vehicle. The wording "omnidirectional camera" generally refers to a 
camera that can capture an image of an object in a wide angle of 
180° or greater with respect to the camera; however the 
omnidirectional camera of the present description is not limited to 

15 this angle. 

Fig. 7(a) and Fig. 7(b) illustrate examples of portions in which 
the omnidirectional cameras 1 are provided. Each broken line in Fig. 
7(a) and Fig. 7(b) indicates limitation of an angle covered by each 
omnidirectional camera 1 for the image capture. 
20 Fig. 7(a) illustrates an example in which the omnidirectional 

cameras 1 are provided on a roof of the vehicle. Specifically, in 
order to eliminate the blind spot, the omnidirectional cameras 1 are 
provided in four sides of the roof of the vehicle, i.e., a front side, a 



- 12 - 

rear side, a left side, and a right side. An advantage in providing 
the omnidirectional cameras 1 on the roof lies in that an angle of 
each omnidirectional camera 1 can be kept because the 
omnidirectional camera 1 on the roof is hardly hit by anything 
5 during driving. 

Fig. 7(b) illustrates an example in which four omnidirectional 
cameras 1 are provided in three portions of the vehicle. Specifically, 
two of the omnidirectional cameras 1 are provided in a front end 
portion associated with a front passenger seat, one capturing a 

10 front view image with respect to the vehicle, the other capturing a 
lateral view image with respect to the front passenger seat. Further, 
one of the rest of the omnidirectional cameras 1 is provided in a 
front end portion associated with a driver seat, and captures a 
lateral view image with respect to the driver seat. The last one of 

15 the omnidirectional cameras 1 is provided in a rear end portion 
associated with the driver seat, and captures a rear view image with 
respect to the vehicle. In this case, the blind spot due to the vehicle 
body is certainly eliminated. 

The ignition instruction detection sensor 2 detects a user's 

20 engine start instruction, which is carried out by inserting and 
turning an ignition key. The speed sensor 3 detects speed of the 
vehicle. The door open/close sensor 4 detects opening and/or 
closing of a door. The parking brake sensor 5 detects whether or 
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not the parking brake is in a released state. 

The display panel 7 serves as a display section (display mean) 
for displaying (i) the image captured by each omnidirectional 
camera 1 (i.e. at least part of or a whole of an image captured by 
5 the omnidirectional camera 1 or the omnidirectional cameras 1); (ii) 
information obtained by the sensors 2 through 5; and (iii) other 
information or image. The liquid crystal panel 7 of the present 
system has a very wide screen whose aspect ratio (ratio of (i) a 
width (horizontal side) of a display region, to (ii) a length (vertical 

10 side) thereof) is 7 : 3 or greater. This allows to display together (i) 
the image captured by each of the omnidirectional cameras 1, and 
(ii) gauges such as a speed meter, an engine speed meter, a fuel 
remaining amount gauge. 

Fig. 2 is an explanatory diagram illustrating an example of 

15 contents displayed on the liquid crystal panel 7. In the example 
shown in Fig. 2, displayed on the liquid crystal panel 7 are: (i) the 
speed meter; (ii) an image indicating a state (hereinafter, referred to 
as "vehicle state") of the vehicle; and (iii) the image, captured by 
the omnidirectional camera 1, of the surroundings around the 

20 vehicle. The image indicating the vehicle state is displayed together 
with an image of the vehicle, in a central portion (portion in the 
vicinity of the speed meter) of the speed meter. The respective 
images of the vehicle and the vehicle state are not the image data 



captured by the omnidirectional camera 1, but are respective 
graphic images (bitmap data) that show the vehicle and the vehicle 
state and that are stored in an image DB (data base) (not shown). 
Moreover, the displayed vehicle state is results of the detections 
5 carried out by the sensors provided in the vehicle. For example, a 
detection result by the door open/close sensor 4 is displayed 
together with the image of the vehicle. 

The control section 6 includes the CPU 10 and the frame 
memory 11. The CPU 10 is a central section of the present system, 

10 and controls all the operations of the present system. Specifically, 
the CPU 10 activates the present system in synchronization with 
the turning of the ignition key to an ON position, in order to 
capture the image by using the omnidirectional camera 1 and to 
display the captured image. The capture and display of the image 

15 are carried out according to (i) the detection result of the sensors 2 
through 5, and (ii) the like. The frame memory 11 temporally stores 
the image data of the image captured by the omnidirectional camera 
1. 

Here, a flow of processes in the present system will be 
20 explained. Fig. 3 is a flowchart illustrating the flow of the processes 
in the present system. 

As shown in Fig. 3, during the stop state in which the engine 
is not in operation, the present system monitors as to whether or 



not the ignition key is turned to the ON position (SI). In other 
words, during the stop state in which the engine is not in operation, 
the CPU 10 monitors, via the ignition instruction detection sensor 2, 
as to whether or not the ignition key is turned to the ON position. 
5 When the ignition instruction detection sensor 2 detects the 

turning of the ignition key to the ON position, the CPU 10 activates 
the present system (S2). In other words, the CPU 10 turns ON 
power to the present system. Electric power for the present system 
is supplied from an engine start battery of the vehicle. 

10 Next, the CPU 10 controls the omnidirectional camera 1 to 

carry out the omnidirectional image capture (S3). The CPU 10 
converts image data of the image captured by the omnidirectional 
camera 1, to image data suitable for the display on the liquid 
crystal panel 7, and transmits the converted image data to the 

15 frame memory 11 for the purpose of the temporary storage therein 
(S4). 

Next, the CPU 10 turns ON the liquid crystal panel 7 (S6). As 
described below, until the speed of the vehicle reaches 10 km/h, 
the present system repeats (i) the image capture by using the 
20 omnidirectional camera 1, and (ii) the display of the captured image. 
Therefore, in cases where the power of the liquid crystal panel 7 
has already been ON, the process in S6 is skipped (S5). 

Next, the CPU 10 sequentially transmits the image data, which 
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is stored in the frame memory 11, to the liquid crystal panel 7. 
With this, the image captured by the omnidirectional camera 1 is 
displayed on the liquid crystal panel 7 (in accordance with the 
image data) (S8). In the present system, the image captured by the 
5 omnidirectional camera 1 is displayed on the liquid crystal panel 7 
in the following manner. That is, an image corresponding to a 
predetermined angular range is displayed (the angular range is 
based on the vehicle as center), (e.g. if the image corresponding to 
an angular range of 30°, the image between, e.g. 0° and 30° with 

10 respect to the vehicle as the center is displayed.) Then, an image of 
another direction (capturing direction of an image) is displayed on 
and on. With this, the surroundings around the vehicle can be 
checked by, for example, rotating the captured image at the angle of 
360° with the vehicle centered. 

15 Further, on this occasion, the CPU 10 monitors the speed of 

the vehicle via the speed sensor 3 (S9). When the speed of the 
vehicle is less than 10 km/h, the CPU 10 judges that the starting 
operation (for starting the transportation device) by the driver is 
not completed, and repeats the processes from S3. In other words, 

20 the CPU 10 causes the omnidirectional camera 1 to continue the 
image capture, and causes the liquid crystal panel 7 to display the 
captured data sequentially. On this account, the image information 
displayed on the liquid crystal panel 7 is always the most recently 
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captured one. 

Meanwhile, when the speed of the vehicle reaches or exceeds 
10 km/h in S9, the CPU 10 judges that the starting operation by 
the driver is completed, and stops the operation of the 
5 omnidirectional camera 1 (S10). Then, the CPU 10 causes the liquid 
crystal panel 7 to display image information suitable for ordinary 
traveling of the vehicle (Sll). Here, the image information suitable 
for ordinary traveling indicates, for example, (i) the display of the 
gauges such as the speed meter, the engine speed meter, and the 

10 fuel remaining amount gauge; (ii) a display of navigation 
information; and (iii) the like. 

While carrying out the image display suitable for the ordinary 
traveling, the CPU 10 monitors via the ignition instruction 
detection sensor 2 whether or not the ignition key is turned to an 

15 OFF position (S12). While the ignition key is in the ON position, the 
operation in Sll (i.e., the display of the image information suitable 
for the ordinary traveling) continues. When the ignition key is 
turned to the OFF position, the CPU 10 turns OFF the liquid crystal 
panel 7 (S13), and turns OFF the power to the present system (S14). 

20 This ends the operations of the present system. 

As described above, the present system shows the 
omnidirectional image to the driver when starting the vehicle in the 
parked state. With this, the driver can check, through the image 
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captured by the omnidirectional camera 1, e.g., (i) safety in an area 
which is difficult to check visually for the operator, or (ii) an area 
in a direction in which it is difficult to check visually for the 
operator. In other words, the present system thus provided in the 
5 vehicle allows easy and effective safety check for the surroundings 
around the vehicle when starting the vehicle, and accordingly 
allows a safer starting operation (driving) of the vehicle in the 
parked state. 

The present system is not limited to the exemplary 
10 arrangement in which the present system is activated in response 
to the turning of the ignition key to the ON position: for example, 
the present system may be activated in response to unlocking of a 
door of the driver seat. The unlocking may be detected by a door 
unlocking sensor (not shown) for detecting the unlocking of the 
15 door. Fig. 4 is a flowchart illustrating an example of an operation of 
the present system having such a structure. 

As shown in Fig. 4, during the parked state in which the 
engine is not in operation, the CPU 10 monitors unlocking of the 
door (S21). The unlocking may be carried out by insertion of a key 
20 or by a keyless entry system. 

When the door unlocking sensor detects the unlocking of the 
door, the CPU activates the present system (S22). 

Next, the CPU 10 controls the omnidirectional cameras 1 to 
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carry out the omnidirectional image capture (S23). The CPU 10 
converts the image data of the image captured by the 
omnidirectional camera 1, to image data suitable for the display on 
the liquid crystal panel 7, and transmits the converted image data 
5 to the frame memory 1 1 for the purpose of the temporary storage 
therein (S24). 

Here, the CPU 10 monitors via the ignition instruction 
detection sensor 2 whether or not the ignition key is turned to the 
ON position (S25). Until the ignition key is turned to the ON 
10 position, the processes in S23 and S24 are repeated. 

Meanwhile, the CPU 10 carries out turning ON of power of the 
liquid crystal panel 7 (S27). As described later, until the speed of 
the vehicle reaches 10 km/h, the present system repeats (i) the 
image capture by using the omnidirectional camera 1, and (ii) the 
15 display of the captured image. Therefore, in cases where the power 
of the liquid crystal panel 7 has already been ON, the process in 
S27 is skipped (S26). 

Next, the CPU 10 instructs that the most recently captured 
image data in the frame memory 11 (S28) is transmitted 
20 sequentially to the liquid crystal panel 7. With this, the liquid 
crystal panel 7 displays the image captured most recently by the 
omnidirectional camera 1 (S29). 

Further, on this occasion, the CPU 10 monitors the speed of 



the vehicle via the speed sensor 3 (S30). When the speed of the 
vehicle is less than 10 km/h, the CPU 10 judges that the starting 
operation by the driver is not completed, and repeats the operations 
from S23. In other words, the CPU 10 causes the omnidirectional 
5 camera 1 to continue the image capture, and causes the liquid 
crystal panel 7 to display the captured data sequentially. On this 
account, the image information displayed on the liquid crystal 
panel 7 is always the most recently captured one. 

On the other hand, in cases where the speed of the vehicle 

10 reaches or exceeds 10 km/h in S30, the CPU 10 judges that the 
starting operation by the driver is completed, and carries out 
processes similar to the processes in S10 through S12 (shown in 
Fig. 3) (S31), and then ends the operation of the present system. 

Alternatively, the present system may be activated in response 

15 to opening or closing of the door of the driver seat (i.e., be activated 
by opening or closing the door). Fig. 5 is a flowchart illustrating an 
example of the operation of the present system in such a case. 

In Fig. 5, during the parked state in which the engine is not in 
operation, the CPU 10 monitors the opening and closing of the door 

20 of the drivers seat (S41). Specifically, during the parked state in 
which the engine is not in operation, the CPU 10 monitors the 
opening and/or closing of the door, via the door open/close sensor 
4. 
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When the door open/close sensor 4 detects the opening or 
closing the door, the CPU 10 activates the present system (S42). 

Next, the CPU 10 controls the omnidirectional camera 1 to 
carry out the omnidirectional image capture (S43). The CPU 10 
5 converts the image data, captured by the omnidirectional camera 1, 
to image data suitable for the display on the liquid crystal panel 7, 
and transmits the converted image data to the frame memory 1 1 for 
the purpose of the temporary storage therein (S44). 

Here, the CPU 10 monitors, via the ignition instruction 
10 detection sensor 2, the turning of the ignition key to the ON 
position (S45). In cases where the ignition key is not in the ON 
position, the CPU 10 judges whether or not the door is re-opened, 
re-closed, and locked (S55). In cases where the door is not 
re-opened, re-closed, and locked, the processes from S43 are 
15 repeated. In contrast, in cases where the door is re-opened, 
re-closed, and locked, the CPU 10 turns OFF the power of the 
present system (S56), and ends the operation of the present system. 

Meanwhile, in cases where the ignition key is turned to the ON 
position in S45, the CPU 10 turns ON the liquid crystal panel 7 
20 (S47). Note that, as described below, until the speed of the vehicle 
reaches 10 km/h, the present system repeats (i) the image capture 
by the omnidirectional camera 1, and (ii) the display of the 
captured image. Therefore, in cases where the power of the liquid 



crystal panel 7 has already been ON, the process in S47 is skipped 
(S46). 

Next, the CPU 10 instructs that the most recently captured 
image data in the frame memory 1 1 is sequentially transmitted to 
5 the liquid crystal panel 7 (S48). With this, the liquid crystal display 
7 displays the image captured most recently by the omnidirectional 
camera 1 (S49). 

Further, on this occasion, the CPU 10 monitors the speed of 
the vehicle via the speed sensor 3 (S50). When the speed of the 

10 vehicle is less than 10 km/h, the CPU 10 judges that the starting 
operation by the driver is not completed, and repeats the processes 
from the S43. In other words, the CPU 10 causes the 
omnidirectional camera 1 to continue the image capture, and 
causes the liquid crystal panel 7 to display the captured data 

15 sequentially. On this account, the image information displayed on 
the liquid crystal panel 7 is always the most recently captured one. 

Meanwhile, when the speed of the vehicle reaches or exceeds 
10 km/h in the S50, the CPU 10 judges that the starting operation 
by the driver is completed, and stops the operation of the 

20 omnidirectional camera 1 (S51). Then, the CPU 10 causes the liquid 
crystal panel 7 to display the image information suitable for an 
ordinary traveling of the vehicle (S52). 

While carrying out the image display suitable for the ordinary 



traveling, the CPU 10 monitors via the ignition instruction 
detection sensor 2 whether or not the ignition key is turned to the 
OFF position (S53). While the ignition key is in the ON position, the 
operation in the S52 (i.e., the display of the image information 
5 suitable for the ordinary traveling) continues. 

When the ignition key is turned to the OFF position, the CPU 
10 turns OFF the power of the liquid crystal panel 7 (S54), and 
waits for the opening, closing, and locking of the door of the driver 
seat (S55). Until the door of the driver seat is opened, closed, and 
10 locked, the processes from S43 are repeated. 

When the door of the driver seat is opened, closed, and locked, 
the CPU 10 turns OFF the power of the present system (S56), and 
ends the operation of the present system. 

As described above, the present system starts the image 
15 capture, which is carried out by the omnidirectional camera 1, in 
synchronization with the unlocking of the door of the driver seat, or 
with the opening or closing of the door. With this, the surrounding 
around the vehicle can be displayed on the liquid crystal panel 7 
immediately after the driver turns the ignition key to the ON 
20 position. This shortens time required for the check of the surrounds 
around the vehicle. 

In the present system, the CPU 10 stops the operation of the 
omnidirectional camera 1 when the speed of the vehicle reaches or 
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exceeds 10 km/h. However, the present invention is not limited to 
this timing for stopping the operation of the omnidirectional camera 
1. For example, the operation of the omnidirectional camera 1 may 
be stopped when the speed of the vehicle reaches or exceeds other 
5 speed (e.g., 8 km/h or 12 km/h). Alternatively, the operation of the 
omnidirectional camera 1 may be stopped when the parking brake 
is released. In this case, before starting the vehicle, the driver may 
recognize the surroundings in accordance with the image captured 
by the omnidirectional camera 1, and release the parking brake. 

10 Alternatively, the operation of the omnidirectional camera 1 may be 
stopped when a gearshift is shifted to a drive position. In this case, 
the driver may check the surrounding in accordance with the image 
captured by the omnidirectional camera 1 before shifting the 
gearshift to the drive position and starting the vehicle. 

15 Moreover, the operation of the omnidirectional camera 1 may 

be stopped in response to a driver's instruction of ending the image 
capture carried out by the omnidirectional camera 1, the driver's 
instruction inputted via an input section (not shown), which is 
provided to receive the driver's instruction. For such an input 

20 section, the liquid crystal panel 7 can be also used. Specifically, 
the liquid crystal panel 7 may display items (parameters) that the 
driver can input, and the driver may touch a desired item of the 
displayed items so as to input the instruction to the present system. 
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As another arrangement, the present system may additionally 
include, for example, a key input device or a mouse, each of which 
is used as the input section for the present system. Moreover, in 
cases where the present system is provided with an audio system 
5 and/or a navigation system, the input section of the systems may 
be used as an input section (operation section) for the audio system 
and/or a navigation system. Moreover, in cases where the present 
system is provided with a system for electrically adjusting an angle, 
or the like, of a side mirror (fender mirror), the input section may 

10 be used as operation means for electrically adjusting the angle of 
the side mirror). 

Further, in cases where the present system includes such an 
input section, the present system may be so arranged that, via the 
input section, the driver can give instructions such as (i) the 

15 activation and inactivation of the present system, (ii) pause of the 
displayed image, and (iii) zoom of the displayed image. Moreover, 
the present system may be so arranged that the driver can carry 
out various settings, via the input section, such as a setting of 
activation timing of the present system; and a setting of the speed 

20 judged as the completion of the starting operation. 

Further, in the present system, the frame memory 1 1 stores 
the image data of the image captured by the omnidirectional camera 
1; however, the frame memory 11 may store only the most recently 
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captured data. Specifically, in the frame memory 11, previous image 
data may be deleted and only present image data may be stored. 
This allows the frame memory 1 1 to have a smaller storage volume. 
The omnidirectional camera 1 used in the present system is a 
5 camera that can capture the omnidirectional image in an instant, 
but the present invention is not limited to this. For example, the 
omnidirectional camera 1 may be such a camera that rotates about 
a rotation axis perpendicular to earth (ground) in order to 
sequentially capture images in all the directions. Alternatively, the 

10 omnidirectional camera 1 may be such a camera that captures an 
image that is reflected on a rotatable reflector while the reflector 
rotates, the reflector being rotatable about an image capture axis 
and provided such that the reflector is on the image capture axis of 
the camera and has a tilt angle with respect to the image capture 

15 axis (the image capture axis is an image capture direction of the 
camera and which is perpendicular to earth (ground)). 

The portions in which the omnidirectional cameras 1 are 
provided are not limited to the portions shown in Fig. 7(a) and Fig. 
7(b). For example, the omnidirectional camera 1 may be provided in 

20 a bottom portion of the vehicle. In this case, it is possible to 
capture an omnidirectional image of surroundings around a lower 
portion of the vehicle with the use of a single camera, the 
surroundings around the lower portion tending to be the blind spot. 
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Further, the omnidirectional camera 1 may be stored within the 
vehicle and exposed to outside of the vehicle only when carrying out 
the omnidirectional image capture. 

Further, the structure of the omnidirectional camera 1 is not 
5 limited to the structure explained with reference to Fig. 6. For 
example, the omnidirectional camera 1 may be such a camera that 
has a plurality of standard lenses or wide-angle lenses. Examples of 
such a camera having the standard lenses or the wide-angle lenses 
include a CCD and a CMOUS image sensor. In this case, the 

10 omnidirectional image capture may be carried out by using a 
plurality of such cameras provided in different positions of the 
vehicle, and the omnidirectional image can be shown to the driver 
by combining images captured by the cameras. Further, in this case, 
the cameras may be provided in, for example, a front left portion, a 

15 front right portion, a rear left portion, and a rear right portion of 
the vehicle. The cameras thus provided in the portions allow easy 
image capture of the area within the blind spot and of the area in 
the direction in which the blind spot occurs, thereby improving 
safety. Fig. 8(a) and Fig. 8(b) illustrate examples in which the 

20 cameras are provided in these portions. Note that each camera 
shown in Fig. 8(a) and Fig. 8(b) uses the standard lenses. 

Fig. 8(a) shows an example of an arrangement in which, for 
the image capture in at least four directions (front, rear, left, and 
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right with respect to the vehicle), four cameras are provided in the 
following portions of the vehicle. That is, in the front end portion 
associated with the front passenger seat, two of the cameras are 
provided; one carrying out the image capture in the front direction, 
5 the other carrying out the image capture of the side with respect to 
the front passenger seat. Moreover, in the front end portion 
associated with the driver seat, one of the rest of the cameras is 
provided for the image capture of the side with respect to the 
drivers seat. Moreover, in the rear end associated with the drivers 

10 seat, the last one of the cameras is provided for the image capture 
in the rear direction. 

Fig. 8(b) shows an example of an arrangement in which a 
larger number of the cameras are provided as compared with the 
example of Fig. 8(a) for acquirement of a more detailed 

15 omnidirectional image. Specifically, in addition to the cameras 
provided in a similar manner to the example of Fig. 8(a), more 
cameras are provided in the front end portion associated with the 
front passenger seat, and in the front end portion associated with 
the drivers seat. The cameras additionally provided in the front end 

20 portion associated with the front passenger seat capture a front 
view image with respect to the front passenger seat, and the camera 
additionally provided in the front end portion associated with the 
driver seat captures a front view image with respect to the vehicle. 
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By using three or more cameras for the image capture in the front 
direction in this way, the captured image can have no blind spot. 

Further, as the omnidirectional camera 1, an infrared camera 
may be used. Alternatively, lightning means may be provided to 
5 light up a target area of the image capture carried out by the 
omnidirectional camera 1. These arrangements allow easy and 
secure comprehension of the surroundings at night around the 
vehicle in the parked state. 

Further, in the present system, the image capture is carried 

10 out in all the directions by the omnidirectional camera 1, but the 
present invention is not limited to this. For example, the image 
capture may be selectively carried out in such a direction in which 
the blind spot for the driver occurs, for example those areas in the 
front, the left, the right, and the rear with respect to the vehicle 

15 where the driver cannot directly check with eyes or cannot 
indirectly check with the door mirror, a rearview mirror, and the 
like. 

Further, the direction of capturing a required image may be 
selectable (customizable) in accordance with driver's preference or 
20 driving characteristics. In this case, it is preferable that the input 
section be provided to receive the driver's instruction. 

Further, as described above, the present system includes the 
liquid crystal panel 7 having the very wide screen whose aspect 
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ratio is 7 : 3 or greater. In contrast, most of onboard display 
devices for a navigation system or a television broadcasting have an 
aspect ratio of 4 : 3. Therefore, as compared with the conventional 
display devices, the liquid crystal panel 7 provides an extra 
5 (additional) display region having a shape wider than a square 
whose aspect ratio is 3 : 3. The extra display region can be used for 
a display of the speed meter such as a round-shaped speed meter 
which is commonly used because it is easiest to read (legible). The 
liquid crystal display 7 allows a speed meter to be displayed on the 

10 extra display region having a shape wider than the square 
mentioned above in such a manner that the speed meter has such a 
large size sufficiently using a shorter side of the extra display 
region. This makes it easier for the driver to read the speed meter, 
and thus improves the safety in driving. 

15 Some recent display device has an aspect ratio of 15 : 9 for a 

display of a navigation system. In order to display such a 
navigation system on the liquid crystal panel 7, the aspect ratio of 
the liquid crystal panel 7 may be set at 24 : 9 or greater. Likewise, 
some display device for television has an aspect ratio of 16 : 9. In 

20 order to display a television broadcasting content on the liquid 
crystal panel 7, the aspect ratio of the liquid crystal panel 7 may be 
set at 25 : 9 or greater. There is no particular upper limit value in 
the aspect ratio as long as the shorter side of the liquid crystal 
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panel 7 has a predetermined length or longer, and as long as 
resolution is at a predetermined value or greater. 

Further, it is preferable that the liquid crystal panel 7 have 
486 or more scan lines parallel to the longer side of the liquid 
5 crystal panel 7. In this case, the liquid crystal panel 7 can 
accommodate two display regions in W-QVGA format (Wide Quarter 
Video Graphics Array; 400 * 234) in such a manner that the two 
display regions are aligned vertically. With this arrangement a 
plurality of images such as the image of the navigation system and 
10 the rear view image with respect to the vehicle can be displayed in 
such a manner that they can be sufficiently easy to recognize what 
is displayed. 

Further, in an arrangement of the liquid crystal panel 7 
including 400 or more scan lines along the longer side, the image 

15 captured by the omnidirectional camera 1 may be displayed in such 
a manner that a longer side of the image is parallel to the shorter 
side of the liquid crystal panel 7. In this case, for example, an 
image of left or right side with respect to the vehicle is captured by 
the omnidirectional cameral 1 and is displayed on the vertical side 

20 (shorter side) of the liquid crystal panel 7. This makes it easier to 
recognize what is displayed. Further, a commercially available 
graphic chip can be used for the arrangement. Therefore, with this 
arrangement, a manufacturing cost can be reduced. 
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Further, in the arrangement including 400 or more scan lines 
along the longer side, the image captured by the omnidirectional 
camera 1 may be displayed in such a manner that a shorter side of 
the image is parallel to the shorter side of the liquid crystal panel 7. 
5 In this case, for example, an image front or rear with respect to the 
vehicle is captured by the omnidirectional cameral 1, and is 
displayed on a horizontal side (longer side) of the liquid crystal 
panel 7. This makes it easier to recognize what is displayed. 
Further, this system may be arranged such that the captured image 

10 is displayed on the liquid crystal panel 7 in either portrait or 
landscape orientation in accordance with a capturing direction of 
an image captured by the omnidirectional camera 1. 

Moreover, when the present system displays the image 
captured by the omnidirectional camera 1, ways of displaying the 

15 speed meter, the engine speed meter, the fuel gauge, and the like 
may be changed. For example, instead of displaying image of these 
meters for the gauges, still the gauges may be illustrated merely in 
numbers or in graph, thereby reducing the display region for the 
meters even though the driver still can read the gauges. This 

20 widens the display region for the image captured by the 
omnidirectional camera 1, so that the driver can more accurately 
grasp the surroundings of the vehicle. 

In the case where the size of the display region for the image 
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captured by the omnidirectional camera 1 is changeable, it is 
preferable that a display line on one side (one end portion) of the 
display region be kept at a constant position even when changing 
the size. If the image is not displayed according to such a reference 
5 point and is displayed in various positions, an edge (end portion) of 
the displayed image is moved. This possibly distracts driver's 
attention, and makes it difficult to recognize what is displayed. For 
prevention of such unnecessary movement of the image in the case 
where the display region is changeable, a fixed reference point (one 

10 side of the display region) is determined. This allows realization of 
the liquid crystal panel 7 by which the driver can comfortably check 
the displayed image. 

In the present system, the gauges necessary for the driving, 
and the image captured by the omnidirectional camera 1 are 

15 displayed together on the display panel 7; however, the present 
invention is not limited to this arrangement. For example, the 
gauges and the image may be displayed on different panels that are 
provided individually. 

Further, the present system uses the liquid crystal panel 7 as 

20 the display section; however, the present invention is not limited to 
this. The display section of the present system may be any types of 
display panels that can display the image captured by the 
omnidirectional camera 1. Examples of such display panels are: an 
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organic EL (Electro Luminescence) panel, a plasma display panel, a 
CRT (Cathode Ray Tube), and the like display device. 

Further, the present system may further include a display 
device (fail-safe system) for fear of emergencies such as (i) 
5 breakdown of the liquid crystal panel, and (ii) fail of attaining 
practically desired response speed due to a low temperature. 
However, even in such cases, the gauges such as the speed meter 
need to be appropriately displayed in order to let the drive to 
continue driving safely. For this reason, the present system may 

10 include the emergency display device (not shown) made up of a 
transparent EL (electro-luminescence) panel. With this, even when 
the liquid crystal panel 7 is broken or the display deficiency occurs, 
the driver can do safe driving by way of the speed meter and the 
like displayed on the emergency display device. 

15 Further, in the present system, the display panel 7 displays 

both the gauges such as the speed meter, and the image captured 
by the omnidirectional camera 1. In this case, the gauges may 
become difficult to read when, for example, brightness of the other 
display region is far above brightness of the display region for the 

20 gauges. In order to prevent this, it is preferable to arrange the 
present system so that the brightness of the other display region 
does not exceed the brightness of the display region for the gauges. 
For example, when the brightness of the other display region 



- 35 - 

becomes higher than the brightness of the display region for gauges, 
the brightness of the other display region may be decreased as 
lower than the brightness of the display region for the gauges. 
Alternatively, the brightness of the other display region may be 
5 restricted not to be higher than a predetermined threshold so that 
it will not be higher than the threshold. 

Further, as described above, the display panel 7 in the present 
system also displays the image indicating the vehicle state together 
with the image of the vehicle, in addition to the speed meter and 

10 the image captured by the omnidirectional camera 1. The vehicle 
state displayed on this occasion is not limited to the 
aforementioned opening and closing of the door. For example, there 
may be provided various in-vehicle sensors, and the vehicle state 
according to detection results by the sensors may be displayed on 

15 the display panel 7. In this case, the vehicle state may be displayed 
by using a graphic image that is stored beforehand in the image DB 
and that is selected according to the detection results of the 
in-vehicle sensors. 

Examples of such in-vehicle sensors include: the ignition 

20 instruction detection sensor 2; the speed sensor 3; the door 
open/close sensor 4; the parking brake sensor 5; a tire pressure 
detection sensor for detecting tire pressure of each tire; an 
in-vehicle temperature sensor for measuring temperature in the 
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vehicle; an outside temperature sensor for measuring temperature 
outside the vehicle; a sticking object sensor for detecting whether 
or not something (such as a hand or a leg of the passenger) sticks 
out of a window of the vehicle; a lamp sensor for detecting whether 
5 or not it is possible to signal lamps such as a brake lamp, a 
direction indicator, and a head lamp; a fuel sensor for detecting a 
remaining amount of fuel; a seatbelt sensor for detecting whether a 
seatbelt is fastened or not; a steering sensor for detecting a 
steering angle of the steering wheel; a shift position sensor for 

10 detecting a shift position; various remaining amount sensors for 
detecting remaining amounts of various fluids such as brake oil, 
engine cooling water, power-steering oil, battery fluid, and washer 
fluid; an oil quality deterioration sensor for detecting degree of 
deterioration of the engine oil; a tire wear sensor for detecting a 

15 remaining amount of tire thread; a brake pad wear sensor for 
detecting how much a brake pad is worn; an electric system 
malfunction detection sensor for detecting whether or not there is a 
malfunction in an electric wiring system; an battery sensor for 
detecting a charge amount of a battery; a distance sensor (object 

20 sensor) for measuring a distance between the vehicle and obstacles 
(e.g., a parked vehicle adjacent to the vehicle, and a wall) around 
the vehicle; a direction sensor for detecting which direction the 
vehicle is in. In other words, the examples of the in-vehicle sensors 
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can include any sensors for detecting states and situations both 
inside and outside of the vehicle. 

Note that timings for detecting the vehicle state by the sensors 
are not particularly limited. The detection timings may be 
5 determined according to each characteristic of the sensors so that 
the driver can check the detection results when starting the vehicle. 
For example, the detections may be carried out in synchronization 
with the turning of the ignition key to the ON position, or with the 
opening and closing, or the unlocking of the door. 
10 Further, a direction of the displayed image of the vehicle may 

be changed according to the detection result of the direction 
sensor. 

Further, among the detection results of the sensors, 
information displayed on the liquid crystal panel 7 may be only 

15 about a factor that possibly works against the driving. A judgment 
on whether or not a factor possibly works against the driving is 
made by the CPU 10. In this case, the judgment may be carried out, 
for example, as follows. That is, there is provided a database (not 
shown) containing an acceptable value for the detection result of 

20 each sensor, and the CPU 10 compares the detected value of the 
sensor with the acceptable value for the detection result. 

The system of the present invention may be arranged such 
that the information about the factor, which the CPU 10 judges that 
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it possibly works against the driving, may stop being displayed on 
the liquid crystal panel 7 when the factor is removed by, for 
example, driver's reaction. 

Further, when there is an obstacle, a warning may be 
5 displayed on the liquid crystal panel 7. Alternatively, the warning 
may be notified by sound (voice) from an additionally provided 
audio output device. Furthermore, in order to call driver's attention 
to the obstacle, a zoom process section may be provided. The zoom 
process section carries out a digital process with respect to an 

10 image of obstacle so as to obtain a zoomed obstacle image, and 
displays the zoomed obstacle image. 

Further, the arrangement including the steering sensor and 
the distance sensor may further include a database storing (i) data 
of the shape of the vehicle, and (ii) data of a relation between the 

15 steering angle and radius gyration of the vehicle. According to the 
database and the detection results of the steering sensor and the 
distance sensor, the CPU 10 may calculate and show, to the driver, 
an appropriate steering amount (steering angle) for avoiding 
collision with an obstacle or the like when starting the vehicle. The 

20 steering angle may be exhibited by displaying an image indicating a 
steering direction. 

Alternatively, the arrangement may include the steering sensor 
and the database storing (i) the data of a relation between the 
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steering angle and radius gyration of the vehicle; and (ii) the like. 
The CPU 10 may calculate, based on the database and the detection 
result of the steering sensor, an appropriate steering amount 
(steering angle) allowing no collision with an obstacle or the like 
5 when starting the vehicle, and show the calculated steering amount 
to the driver. The steering angle may be exhibited by displaying an 
image indicating a steering direction. 

In these arrangements, the CPU 10 serves as vehicle situation 
check means and vehicle situation judgment means. The vehicle 

10 situation check means recognizes the detection results of the 
sensors and the result of the image capture carried out by the 
omnidirectional camera 1. The vehicle situation judgment means 
judges whether or not the detection results and the result of the 
image capture include the factor that possibly works against the 

15 driving. 

Further, the CPU 10 may detect the situation of the vehicle in 
accordance with the detection result of the object sensor and with 
the image captured by the omnidirectional camera 1. Moreover, 
according to the detected result, the CPU 10 may carry out 
20 selection of images indicating the vehicle state and display the 
selected image. Further, the CPU 10 may detect which direction the 
vehicle is in with respect to a major road (the widest portion of a 
road facing the parked vehicle), and may display the image of the 
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vehicle in conformity with the direction. 

Further, in the present system, upon the detection of the 
factor that possibly works against the driving, an animation image 
may be displayed on the liquid crystal panel 7 to advise how to 
5 react to the factor. In this case, the present system may include a 
database (not shown) that beforehand stores (i) an item that is 
possibly detected as the factor which possibly works against the 
driving; and (ii) ways of reacting to the factor. 

On this account, even when detecting the factor that possibly 

10 works against the driving, the driver can easily and accurately react 
to the factor. For example, when the tire pressure is extremely low, 
animation images are displayed, instructing a way of setting up an 
emergency triangle warning; an area where a spare tire and a tire 
exchanging tool are stored; usage of the tool; procedures of 

15 exchanging tires; and the like. 

Further, the information indicating the vehicle state may be 
image data that is selected from the image DB. Specifically, the 
CPU 10 may recognize the surroundings around the vehicle in 
accordance with the image data captured by the omnidirectional 

20 camera 1, and may select image data that matches with the 
recognized image data, and may display the selected data together 
with the image of the vehicle. For example, when there are an 
obstacle and the like around the vehicle, the CPU 10 may recognize 



shapes of them, and select respective images, from the image DB, 
similar to the shapes, and display the selected images. 

Further, in the present system, the vehicle state is displayed 
together with the image of the vehicle; however, this is not only an 
5 arrangement of the present system. For example, the detection 
results of the sensors may be solely displayed. However, by 
displaying the vehicle state together with the image of the vehicle, 
the driver can surely and promptly recognize which part of the 
vehicle is responsible for the factor that possibly works against the 

10 driving. Therefore, it is preferable that the vehicle state be 
displayed together with the image of the vehicle. Moreover, the 
image of the vehicle may be displayed away from the speed meter. 

Further, in the present system, the vehicle state is displayed, 
adjacent to the speed meter, together with the image of the vehicle; 

15 however, the present system is not limited to this. However, by 
displaying the vehicle state adjacent to the speed meter, the driver 
does not need to look more than one part of the display panel to 
check the vehicle state. This can reduce load imposed on the driver, 
and can prevent oversight of checking the vehicle state. 

20 Further, data addition and data amendment may be carried 

out with respect to the image DB storing the graphic images 
indicating the vehicle and the vehicle state. In this case, when the 
vehicle body is repainted or modified, the image of the vehicle can 
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be changed in accordance with the modified or repainted vehicle 
body. The change of the image of the vehicle may be carried out by 
using data downloaded via communication line; data read from an 
external memory; and data selected from data stored beforehand in 
5 a large volume HD (hard disk) provided in the present system. 

Further, in addition to the arrangement, the present system 
may further include a speaker (audio output means). In this case, 
the direction of the image displayed on the liquid crystal panel 7 
may be notified by voice (sound). 

10 Further, in the case where the present system is able to detect 

the factor judged that it possibly works against the driving, 
existence of the factor may be notified by both the display on the 
liquid crystal panel 7, and voice (sound) outputted from the speaker. 
In this case, warning sound or voice may be used to notify (i) an 

15 area responsible for the existence of the factor judged that it 
possibly works against the driving, and (ii) things to be bewared. 

Further, the present system may further include a 
communication device that is connectable to a communication line 
such as the Internet. In this case, the driver can check information 

20 about his/her destination before starting moving the parked vehicle. 
For example, in cases where the driver goes to a movie theater, the 
driver can beforehand check a content of a movie that is on now, 
and can check traffic information of roads to the theater. Moreover, 
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the driver can buy a ticket and can reserve a seat. Further, by 
using the communication device, the driver can reserve a 
restaurant, and can view a menu of the restaurant, and can make 
an order. 

5 Further, the present system may execute various kinds of 

application software for use in a personal computer. In this case, a 
network meeting can be held by using the present system. In other 
words, the liquid crystal panel 7 can be also used as a personal 
computer monitor. In the case where the present system can 

10 execute various kinds of application software, the application 
software can be displayed, e.g. on a full screen, that is, on an 
entire display region of the liquid crystal panel 7. 

Further, in the case where the present system is capable of 
communication, the activation of the present system may be carried 

15 out via the communication network. Further, the image captured by 
the omnidirectional camera 1 may be transmittable via the 
communication line. In this case, it is possible to remotely carry 
out (i) the activation of the present system, and (ii) the check of the 
captured image of the surroundings of the vehicle, the image being 

20 captured by the omnidirectional camera 1 . 

Further, in the present system, designs of the items displayed 
on the liquid crystal panel 7 may be customizable by the driver. 
Examples of the customizable designs may include: sizes, colors, 



layouts (display positions) of the speed meter, the engine speed 
meter, and the fuel gauge. However, because an item such as the 
speed meter is important for the safe driving, it is preferable that 
the customization of design of an item required for the safe driving 
5 be allowed within a predetermined condition range, in order that it 
may be sufficiently easy to recognize the content of the item. For 
this reason, the present system may include, for example, a 
database (not shown) storing such customizable ranges that 
respectively correspond to the display items. Further, in the case 

10 where the present system is capable of communication, such a 
database may be provided on a server. From the database, a design 
within the customizable range may be selectable according to 
driver's preference. Further, when the design customized according 
to driver's instruction is out of the customizable range, amendment 

15 may be made so that the design customized according to the 
driver's instruction falls within the customizable range. 

Further, the above explanation assumes that the power source 
of the present system is the engine start battery; however, the 
power supply means for the present system is not limited to this 

20 and is arbitrarily changeable. For example, there may be provided 
power supply means exclusively used for the present system. 

Further, the present system is provided in a vehicle, and the 
wording "vehicle" in the description encompasses any kind of 
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terrestrial transportation device, such as an automobile, a 
motorcycle, and a bicycle. Moreover, the present system is 
applicable not only to the vehicle but also to any types of 
transportation device requiring manual maneuver. Examples of 
5 such a transportation device include: a helicopter, an airplane, and 
a ship. 

Further, the above explanation assumes that the present 
system shows, to the driver, the surroundings around the vehicle 
when starting moving the vehicle in the parked state (stop state); 

10 however, the present system is not limited to this. For example, the 
present system may shows, to the driver, the image captured by the 
omnidirectional camera 1 when stopping or parking the vehicle or 
the like. Further, the image captured by the omnidirectional camera 
1 may be shown to the driver in response to the driver's 

15 instruction. 

The invention being thus described, it will be obvious that the 
same way may be varied in many ways. Such variations are not to 
be regarded as a departure from the spirit and scope of the 
invention, and all such modifications as would be obvious to one 
20 skilled in the art are intended to be included within the scope of 
the following claims. 

For example, the control section 6 of the present system may 
be constituted by hardware logic, or by software with the use of a 
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CPU as follows. 

That is, the present system has: (i) the CPU for executing an 
instruction of control program realizing various functions; (ii) a 
ROM storing the program; (iii) a RAM for expanding the program; 
5 (iv) a storage device (storage medium) such as a memory storing the 
program and various data; and (v) the like. The object of the 
present invention also can be achieved by (i) providing, for the 
present system, a storage medium storing, in a computer readable 
manner, a program code (executable program; intermediate code; 

10 source program) of the control program for the present system, and 
(ii) causing a computer (CPU or MPU) to read and execute the 
program code stored in the storage medium, the program code being 
the software realizing the aforementioned functions. 

Examples of the storage medium are: (i) tapes such as a 

15 magnetic tape and a cassette tape; (ii) magnetic disks such as a hard 
disk and a flexible disk; (iii) optical disks such as a CD-ROM 
(compact disk read only memory), a magnetic optical disk (MO), a 
mini disk (MD), a digital video disk (DVD), and a CD-R 
(CD-Rewritable); (iv) cards such as an IC card (inclusive of a memory 

20 card) and an optical card; and (v) semiconductor memories such as a 
mask ROM, an EPROM (electrically programmable read only memory), 
an EEPROM (electrically erasable programmable read only memory), 
and a flash ROM. 
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The present system may be connectable to the communication 
network, and the program code may be supplied via the 
communication network. The communication network is not 
particularly limited. Specific examples thereof are: the Internet, 
5 Intranet, Extranet, LAN (local area network), ISDN (integrated 
services digital network), VAN (value added network), CATV (cable TV) 
communication network, virtual private network, telephone network, 
mobile communication network, satellite communication network, and 
the like. Further, the transmission medium constituting the 

10 communication network is not particularly limited. Specific examples 
thereof are: (i) a wired channel using an IEEE 1394, a USB (universal 
serial bus), a power-line communication, a cable TV line, a telephone 
line, a ADSL line, or the like; or (ii) a wireless communication using 
IrDA, infrared rays used for a remote controller, Bluetooth®, IEEE 

15 802.11, HDR (High Data Rate), a mobile phone network, a satellite 
connection, a terrestrial digital network, or the like. Note that, the 
present invention can be realized by (i) a carrier wave realized by 
electronic transmission of the program code, or (ii) a form of a series 
of data signals. 

20 

INDUSTRIAL APPLICABILITY 

The surroundings exhibiting system and the surroundings 
exhibiting method of the present invention are applicable to any 
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kinds of transportation device requiring manual maneuver for 
traveling. Examples of such transportation device include: an 
automobile, a motorcycle, a bicycle, a helicopter, an airplane, and a 
ship. 



